Method, apparatus and system for enhancing a display of video data

ABSTRACT

Techniques and mechanisms for providing an enhanced display of video content. In an embodiment, analysis of one or more frames of audio-video (AV) information is performed to identify first video data as representing smooth image content, where second video data represents edge image content. Based on the identifying of the first video data, enhancement processing is performed to selectively apply a noise component to the first video data. Of the first video data and the second video data, the enhancement processing modifies only the first video data. In another embodiment, a refresh rate for displaying a sub-portion of a magnified image is selectively set based on the first video data being identified as representing smooth image content. Enhancement with selective noise and/or refresh rate variation improves perceived resolution of smooth image content, as seen by a viewer of the resulting image.

BACKGROUND

1. Technical Field

This disclosure relates generally to displays, and in particular but notexclusively, relates to tiling displays.

2. Background Art

Large wall displays can be prohibitively expensive as the cost tomanufacture display panels rises exponentially with display area. Thisrise in cost results from the increased complexity of large monolithicdisplays, the decrease in yields associated with large displays (agreater number of components must be defect free for large displays),and increased shipping, delivery, and setup costs. Tiling smallerdisplay panels to form larger multi-panel displays can help reduce manyof the costs associated with large monolithic displays.

While conventional multi-panel displays can reduce costs, visually theytend to have a major drawback. For example, a conventional display panelincludes a bezel around its periphery. A bezel is a mechanical structurethat houses a pixel region in which the display's pixels are disposed.In recent years, manufactures have reduced the thickness of bezelsconsiderably to less than 2 mm. However, even these thin bezel trims arestill very noticeable to the naked eye, distract the viewer, andotherwise detract from the overall visual experience.

Various approaches for obtaining seamless displays are being developed,include display lensing, blended projection, stackable display cubes,and LED tiles. However, as successive generations of displaytechnologies continue to improve the size and resolution of displaydevices, the quality of image display at the edge-to-edge interfaces ofdisplay devices and the number of display devices which can be combinedfor displaying images, there is expected to be an increase in theperceptibility of limitations or flaws in such displayed images.Accordingly, there is an attendant need to reduce of otherwise mitigatethe effects of such limitations or flaws.

BRIEF DESCRIPTION OF THE DRAWINGS

The various embodiments of the present invention are illustrated by wayof example, and not by way of limitation, in the figures of theaccompanying drawings and in which:

FIG. 1 is an illustration of a tileable display panel to displayenhanced video data according to an embodiment.

FIG. 2 is a transparent illustration of a tileable display panelaccording to an embodiment.

FIG. 3 is an illustration of a tileable display panel to displayenhanced video data according to an embodiment.

FIG. 4 is a flow diagram illustrating elements of a method forprocessing video data for display according to an embodiment.

FIG. 5 is a block diagram illustrating elements of video a processor toenhance video data according to an embodiment.

FIG. 6 is a representation of an image displayed according to anembodiment.

FIG. 7 is a block diagram illustrating elements of a display device toprocess and display video data according to an embodiment.

FIG. 8A is an illustration of an assembly of display devices to displayvideo data according to an embodiment.

FIG. 8B illustrates features of an image displayed based on enhancedvideo data according to an embodiment.

FIG. 9 is an illustration of components of a hardware platform accordingto an embodiment.

DETAILED DESCRIPTION

Embodiments discussed herein variously provide for the displaying ofselectively enhanced video content. Selective display enhancement may bebased on a determination that a portion of video data represents eitherof what is referred to herein as edge image content and smooth imagecontent. For example, video data may be enhanced to provide a ditheringor other noise property to an image sub-portion which represents smoothimage content. Such dithering/noise may improve perceived resolution ofsuch smooth image content, as seen by a viewer of the resulting image.

Certain embodiments are discussed herein in the context of enhancing adisplay of video content by one or more tileable display panels whicheach include mechanisms to project magnified sub-images on a respectivescreen layer structure. However, certain embodiments are not limited inthis regard, and such discussion may be extended to additionally oralternatively apply to enhancing a display of video content by any of avariety of other types of display devices.

FIG. 1 is an illustration of a tileable display panel according to anembodiment. In this embodiment, tileable display panel 100 includesdisplay layer 120 disposed between screen layer 110 and illuminationlayer 130, which includes light sources 131, 132, 133, 134, 135, and 136configured in a two-dimensional (2D) array. FIG. 1 shows that each lightsource in illumination layer 130 illuminates a corresponding array oftransmissive pixels (referred to herein as a “pixelet” and describedfurther below) to project a plurality of image sub-portions onto thebackside of screen layer 110 so that the screen layer displays a unifiedimage.

In one embodiment, each of light sources 131-136 of illumination layer130 is a laser. In one embodiment, each light source is alight-emitting-diode (“LED”) that emits light from a relatively smallemission aperture. For example, LEDs with an emission aperture of150-300 microns may be used. The LED may emit display light (e.g., whitedisplay light, blue display light, or any laser light). Each of lightsources 131-136 is configured to emit its display light at a limitedangular spread so the display light is directed toward a specificpixelet in display layer 120 (described further below). In oneembodiment, additional optics are disposed over the light source in thearray of light sources to define the limited angular spread of thedisplay light emitted from the light sources. The additional optics mayalso increase brightness uniformity of the display light propagatingtoward the pixelets.

Display layer 120 is illustrated to include pixelets 121, 122, 123, 124,125, and 126 configured as a matrix (i.e., a 2D array). The pixelets maybe liquid-crystal-displays (“LCDs”)—e.g., color LCDs or monochromaticLCDs. Where the pixelets are LCDs, a micro-lens in the pixel may not beneeded. In one embodiment, each pixelet measures 20×20 mm.

Pixelets 121-126 are shown to be configured in a 2×3 matrix in thisembodiment. The pitch between each pixelet in the matrix may be thesame. In other words, the distance between a center of one pixelet andthe center of its adjacent pixelets may be the same distance. In theillustrated embodiment, each light source in illumination layer 130 hasa one-to-one correspondence with a pixelet. For example, light source131 corresponds to pixelet 121, light source 132 corresponds to pixelet122, light source 133 corresponds to pixelet 123, and so on. Also in theillustrated embodiment, each light source is centered under itsrespective corresponding pixelet. Other embodiments may have a differentlight source-to-pixelet correspondence, or different light sourcepositioning.

Display layer 120 also includes spacing regions 128 surrounding pixelets121-126. Pixelet 126 is illustrated to be adjacent to pixelet 123 and125. Pixelet 126 is spaced by dimension 162 from pixelet 125 and spacedby dimension 164 from pixelet 123. Dimensions 162 and 164 may beconsidered “internal spacing” and may comprise the same distance in someembodiments. Pixelet 126 is also spaced by dimensions 161 and 163 fromedges of display layer 120. Dimensions 161 and 163 may be considered“external spacing” and are the same distance, in some embodiments. Inone embodiment, dimensions 161 and 163 are half of the distance asdimensions 162 and 164. In one example, dimensions 161 and 163 are both2 mm and dimensions 162 and 164 are both 4 mm.

Spacing region 128 contains a backplane region that may include pixellogic for driving the pixels in the pixelets. The architecture oftileable display panel 100 may increase space for additional circuitryin the backplane region. In one embodiment, the backplane region is usedfor memory-in-pixel logic. This memory may be used to allow each pixelto be refreshed individually instead of refreshing each pixel in a rowat every refresh interval (e.g. 60 frames per second). In oneembodiment, the backplane region is used for additional imageprocessing.

While tileable display panel 100 may be used in high-resolution largeformat displays, the additional image processing capacity may also beuseful for image signal processing, for example dividing an image intoimage sub-portions that are displayed by the pixelets. In anotherembodiment, the backplane region is used to embed image sensors. In oneembodiment, the backplane region includes infrared image sensors forsensing three-dimensional 3D scene data in the display apparatus'environment.

In operation, display light from a light source (e.g. light source 131)propagates toward its corresponding pixelet (e.g. pixelet 121). Eachpixelet drives their pixels to display an image sub-portion (i.e., aportion of a unified image to be displayed by tileable display panel100) on the pixelet so the display light that propagates through thepixelet includes the image sub-portion displayed by the pixelet. Sincethe light source generates the display light from a small aperture andthe display light has an angular spread, the image sub-portion in thedisplay light gets larger as it gets further away from the pixelet.Therefore, when the display light (including the image sub-portion)encounters screen layer 110, a magnified version of the imagesub-portion is projected onto a backside of screen layer 110.

Screen layer 110 is offset from pixelets 121-126 by distance 166 toallow the image sub-portions to become larger as the display lightpropagates further from the pixelet that drove the image sub-portion.Therefore, distance 166 may be a fixed distance selected to configurethe size of the magnification of the image sub-portions. In oneembodiment, fixed distance 166 is 2 mm. In one embodiment, each imagesub-portion generated by pixelets 121-126 is magnified by 1.5×.

The backside of screen layer 110 is opposite viewing side 112. Screenlayer 110 may be made of a diffusion screen that presents the unifiedimage on viewing side 112 of screen layer 110 by scattering the displaylight (that includes the image sub-portions) from each of the pixelets121-126. Screen layer 110 may be similar to those used inrear-projection systems. Screen layer 110 may have local dimmingcapabilities independent of light sources 131-136.

FIG. 2 is a transparent illustration of a tileable display panelaccording to an embodiment. FIG. 2 illustrates tileable display panel100 looking through screen layer 110 to display layer 120. FIG. 2 showshow tileable display panel 100 can generate a unified image 200 usingthe magnified image sub-portions (e.g. image sub-portion 214) generatedby light sources 131-136 and their corresponding pixelets 121-126. Inthis illustration, pixelet 124 generates image sub-portion 204 that isprojected (using the display light from light source 134) on screenlayer 110 as magnified image sub-portion 214. Although not illustrated,each of pixelets 121, 122, 123, 125, and 126 can also project amagnified image sub-portion onto screen layer 110 that is the same sizeas magnified image sub-portion 214. Those five magnified imagesub-portions combined with magnified image sub-portion 214 combine toform unified image 200. In some embodiments, the geometric alignment ofthe magnified image sub-portions may leave virtually no gap (if any)such that unified image 200 is perceived as seamless by a viewer.

In FIG. 2, the magnified image sub-portions are illustrated to beroughly the same size and are similarly square-shaped. In otherembodiments, said magnified image sub-portions may comprise any shape,any size, and in any combination. To generate same sized magnified imagesub-portions, display layer 120 and pixelets 121-126 may be offset fromlight sources 131-136 by fixed dimension 165 (as shown in FIG. 1). Inone embodiment, dimension 165 is 8 mm.

The device architecture of tileable display panel 100 further allows forcontrolling the brightness of light sources 131-136 based on theimage/video content of the corresponding image sub-portions. Each pairof pixelets 121-126 and light sources 131-136 are independent of eachother, and in some embodiments, light from one pair of pixelet and lightsource (e.g., pixelet 125 and light source 125) does not leak into anyof its neighboring pairs (e.g., pixelet and light source pairs 124/134,126/136 and 122/132). Selectively varying the brightness level and/orrefresh rates for light sources 131-136 based on the image/video contentof the corresponding image sub-portions allows for improved contrast inunified image 200 and a reduced power consumption for tileable displaypanel 100. Furthermore, embodiments may increase the available bit depthfor pixel data, resulting in smoother gradients and improved imagequality.

FIG. 3 is an illustration of components of a tileable display panel fordisplaying image sub-portions according to an embodiment. In thisembodiment, portions of the components of tileable display panel 300 areillustrated from a cross-sectional view as including an illuminationlayer 330 comprising light sources 331-333 to emit display light at alimited angular spread so the display light is directed toward pixelets321 of a display layer 320—e.g. according to techniques describedherein. When display light (including a corresponding image sub-portion)encounters screen layer 310, a magnified version of the imagesub-portion is projected onto a backside of the screen layer so that itis viewable to the user, shown as magnified sub-images 392 from FIG. 3.

Each light source 331-336 is configured to emit a divergent projectionbeam 347 having a limited angular spread that is directed toward aspecific corresponding one of multiple pixelets 321 in display layer320, as illustrated in FIG. 3. In an embodiment, a distance between twoof the pixelets 122 which are closest to one another is greater than adistance between adjacent pixels in either one of those two pixelets.For example, a distance between adjacent pixelets may be in a range of7-20 times the size of a single pixel and/or in a range of 40-100 timesthe distance between pixels of a single pixelet.

In one embodiment, divergent projection beam 347 may be substantiallyshaped as a cone (circular aperture) or an inverted pyramid(rectangle/square aperture). Additional optics may be disposed over eachlight source in the array of light sources to define the limited angularspread (e.g. 20-70 degrees) and/or cross-sectional shape of divergentprojection beam 347 emitted from the light sources. The additionaloptics (including refractive and/or diffractive optics) may alsoincrease brightness uniformity of the display light so that theintensity of divergent projection beam 347 incident upon each pixel in agiven pixelet is substantially similar.

In some embodiments (not illustrated in FIG. 3), divergent projectionbeams 347 from different light sources may overlap upon the spacingregion 328 on the backside of display layer 320. In some embodiments,each pixelet is directly illuminated solely by one divergent projectionbeam from its corresponding light source, which may approximate a pointsource. In certain embodiments, a very small percentage of light fromnon-corresponding light sources may become indirectly incident upon apixelet due to unabsorbed reflections of divergent projection beams 347from non-corresponding light sources. Spacing regions 328 andillumination layer 330 may be coated with light absorption coatings(known in the art) to decrease reflections from non-corresponding lightsources from eventually becoming incident upon a pixelet that does notcorrespond with the light source. The limited angular spread of thelight sources may be designed to ensure that divergent projection beams347 only directly illuminates the pixelet that corresponds to aparticular light source. In contrast, conventional LCD technologyutilizes light sources (e.g. LEDs or cold-cathode-fluorescents) with agenerally Lambertian light distribution and diffusive filters in anattempt to generate uniform and diffuse light for backlighting the LCDpanel. By implementing each light source (e.g., light sources 331-333)as a near point source, each pixel within a given pixelet exclusivelyprojects onto a corresponding region on the backside of screen layer 310on a one-to-one basis.

FIG. 4 illustrates elements of a method 400 for processing video dataaccording to an embodiment. Method 400 may process video data inpreparation for a displaying of magnified sub-image portions by adisplay which, for example, has some or all of the features of tileabledisplay panel 100. In an embodiment, method 400 is performed by any of avariety of hardware logic and/or executing software logic which, forexample, is included in (or operates with) controller logic for anillumination layer and/or a display layer.

Method 400 may include, at 410, receiving one or more frames ofaudio/video information including first video data and second videodata. The one or more frames may be received at 410 via any of a varietyof video sources including, but not limited to, a cable or satellitetelevision provider, a DVD player, gaming console, personal computer,handheld device, wired and/or wireless network and the like. The one ormore frames may include a frame format according to any of a variety ofaudio-video specifications including, but not limited to, HDMI, MHL orthe like. For example, such a frame format may include a video dataregion and one or more other regions for audio data and/or controlinformation associated with the video data region. In an embodiment, theone or more frames include a first frame comprising the first video dataand the second video data. Alternatively, the first video data and thesecond video data may span multiple frames of AV information. Forexample, the first video data and the second video data may each includerespective video data portions of multiple frames of AV information.

Method 400 may further comprise, at 420, identifying the first videodata as representing smooth image content. As used herein, the terms“smooth image content” and “edge image content” are to be distinguishedfrom one another as different types of content as represented inrespective displayed image sub-portions. Smooth image content mayinclude that content of an image sub-portion which satisfies some testcriterion for self-consistency with respect to one or more imagecharacteristics. Content of a displayed image sub-portion may beconsidered smooth where, for example, a total range in a color space forall color values of the image sub-portion is at or below some a priorimaximum threshold color range. Alternatively or in addition, suchcontent may be considered smooth where a gradient of color transition ofthe image sub-portion—e.g. any such gradient color transition—is at orbelow some a priori maximum threshold color gradient. Alternatively orin addition, such content may be considered smooth where the imagesub-portion can be identified—e.g. by feature recognition analysis ofthe corresponding video data—as having failed one or more edge detectionevaluations and/or as being at least some minimum threshold distanceaway from a closest instance of edge content in the same image.

By contrast, content represented in a displayed sub-image may beconsidered edge image content where the image sub-portion can beidentified—e.g. by feature recognition analysis of the correspondingvideo data such as Canny edge detection, Marr-Hildreth edge detectionand/or the like—as including one or more edges. Identification of edgeimage content may include operations adapted from conventional edgedetection techniques, the particulars of which are not limiting oncertain embodiments and are not detailed herein.

Method 400 may further comprise, at 430, selectively performing firstimage processing based on the first video data being identified asrepresenting smooth image content. In an embodiment, the selective imageprocessing performed at 430 includes applying a first noise component togenerate a first modified version of the first video data, wherein, ofthe first video data and the second video data, the first imageprocessing modifies only the first video data. Certain embodimentsresult in a viewer unconsciously perceiving such a noise component asbeing comparatively high resolution image content.

By way of illustration and not limitation, the first video data mayinclude a plurality of pixel color values—e.g. where each pixel colorvalue is represented in terms of a RGB color space, a YC_(B)C_(R) colorspace or the like. Some or all such pixel color values may be modifiedby the first image processing at 430—e.g. including variously adding toand/or subtracting from such pixel color values respective random orpseudo random noise values. In one embodiment, pixel values of the firstvideo data are modified by the first image processing at 430 only withrespect to one dimension of a color space—e.g. the blue dimension of theRGB color space.

Application of a noise component may result in an image dithering effectwhich is applied only to selective portions of a final displayedimage—e.g. to provide for an improvement in perceived resolution ofsmooth image content. Such image noise/dithering may vary spatially inthe final resulting image display. For example, method 400 may result ina first magnified image sub-portion based on the first video data beingdisplayed at a first location of a display layer concurrent with asecond magnified image sub-portion (e.g. based on the second video data)being displayed at a second location of a display layer. A level and/ortype of dithering of the first magnified image sub-portion may bedifferent than a corresponding level and/or type of any dithering of thesecond magnified image sub-portion. For example, any noise/ditheringeffect added by method 400 may be only to video data other than thatcorresponding to the second magnified image (e.g. only to video dataother than the second video data).

In an embodiment, dithering resulting from the first image processing at430 may vary over time. For example, method 400 may result in a firstversion of a magnified image sub-portion being displayed at a firstlocation of a display layer, and a subsequent second version of thatsame magnified image sub-portion being displayed at the same firstlocation of the display layer. The different versions may vary, forexample, only (or at least) in terms of the different respectivenoise/dithering values which have been applied thereto.

Alternatively or in addition, the applying of the first noise componentby the selective image processing at 430 may include providing random orpseudo-random variation in a position of a sub-image portion. By way ofillustration and not limitation, a sub-image portion may be repeatedlyprojected in sequence onto a screen layer, where the location of thesub-image portion in the corresponding display layer (e.g. by adifference of a single pixel row and/or a single pixel column) is variedslightly between consecutive projections of the sequence. Such variationmay be achieved, for example, by applying a noise component to a timingfor providing video data to the display layer.

FIG. 5 illustrates elements of a video processor 500 for enhancing videodata according to an embodiment. Video processor 500 may processaudio-video information in preparation for image sub-portions to bedisplayed—e.g. by display 100. For example, such processing may includevideo processor 500 performing method 400.

In an embodiment, video processor 500 includes feature recognition logic510 to receive one or more frames of audio/video information—asrepresented by the illustrative frames 505. Feature recognition logic510 may identify first video data 520 of frames 505 as representingsmooth image content. Alternatively or in addition, feature recognitionlogic 510 may identify second video data 525 of frames 505 asrepresenting edge image content.

In response to such identifying, feature recognition logic 510 mayvariously direct first video data 520 and second video data 525 fordifferent respective video processing. By way of illustration and notlimitation, feature recognition logic 510 may provide first video data520 for processing by enhancement logic 530 of video processor 500,where any processing of second video data 525 based on the identifyingof smooth image content (and/or identifying of edge image content) is toexclude processing by enhancement logic 530. For example, second videodata 525 may bypass processing by enhancement logic 530 or be providedfor other enhancement processing (not shown) which is different thanthat provided by enhancement logic 530. Accordingly, video processing byenhancement logic 530 may be selective—e.g. at least insofar as, offirst video data 520 and second video data 525, such processing is toonly modify first video data 520.

In an embodiment, enhancement logic 530 is coupled to or includes anoise generator 535 to provide a noise component to be applied to someor all of first video data 520 to generate at least one modified versionof first video data 520. Such a modified version of first video data 520is represented in FIG. 5 by the illustrative enhanced video data 540.

Video processor 500 provide second video data 525 and enhanced videodata 540 for various subsequent processing by logic included in orcoupled to video processor 500. By way of illustration and notlimitation, combination logic 550 of video processor 500—e.g. includingone more multiplexers—may interleave or otherwise combine second videodata 525 and enhanced video data 540 with one another to generate anoutput 560 for additional processing by other video processing logic(not shown). Alternatively, second video data 525 and enhanced videodata 540 may be provided as distinct parallel outputs for additionalprocessing by such other video processing logic. Such additionalprocessing may include, for example, one or more operations adapted fromany of a variety of conventional video data processing techniques forgenerating signaling to control the displaying of image sub-portions bydisplay hardware (not shown).

FIG. 6 illustrates elements of an image 600 to be displayed based onvideo data which is enhanced according to an embodiment. Image 600 maybe displayed based on enhanced video data such as that which isgenerated by video processor 500—e.g. according to method 400.Alternatively or in addition, image 600 may be displayed with one ormore display devices which, for example, include some or all of thefeatures of tileable display panel 100.

Image 600 may be a single video frame or other digital image which, forexample, may be variously projected repeatedly over time onto a displaylayer of a display device. Alternatively or in addition, image 600 maybe one of a plurality of different video images which are displayed insequence with one another—e.g. where each image is projected at leastonce on such a display layer.

In an embodiment, different portions (and/or sub-portions) of image 600may be variously projected onto such a display layer. For example, oneportion/sub-portion of image 600 may be repeatedly projected with anillumination element which illuminates repeatedly at a refresh ratedifferent than a refresh rate at which another portion/sub-portion ofimage 600 is concurrently—and in an embodiment, repeatedly—projected.Alternatively or in addition, a total number of times that oneportion/sub-portion of image 600 is projected on the display layer maydiffer from a total number of times that another portion/sub-portion ofimage 600 is concurrently projected on the display layer.

The difference between the number of projections and/or refresh ratesfor various portions/sub-portions of image 600 may be based, forexample, on the respective content represented in suchportions/sub-portions of image 600. For example, a portion/sub-portionof image 600 which represents smooth image content may be refreshed at ahigher rate than another portion/sub-portion of image 600 whichrepresents edge image content.

In an illustrative scenario according to one embodiment, image 600 mayinclude a portion 610 comprising a representation of an edge 620 which,for example, is located at an interface of two regions of differentrespective colors (and/or ranges of colors). Portion 610 may bedisplayed based on video data which, for example, includes first videodata corresponding to a first sub-portion 640 of portion 610 and secondvideo data corresponding to a second sub-portion 630 of portion 610.

FIG. 6 shows a detail view of portion 610 as it would be displayed ifthe image processing of the first video data were not enhanced accordingto techniques of certain embodiments. FIG. 6 also shows detail views ofalternative versions 610 a, 610 b, 610 c, 610 d of portion 610, whereeach of the alternative sub-portions 610 a, 610 b, 610 c, 610 dillustrates a result of video data enhancement according to a respectiveembodiment. More particularly, various patterns are shown insub-portions 610 a, 610 b, 610 c, 610 d to represent areas where videonoise artefacts (e.g. dithering and/or location variation) are applied.Such dithering/noise may provide for an improvement in perceivedresolution of sub-portions 610 a, 610 b, 610 c, 610 d.

In portion 610 a, a sub-portion 640 a includes a relatively simpledithering artefact which is added along rows of sub-portion 610 a—e.g.wherein noise is added to pixels within a range of pixel rows, and whereeach such pixel is within a threshold distance of a respective pixel inthe same row which represents part of edge 620. In an embodiment, asub-portion 630 a of portion 610 a which represents edge image contenthas no dithering added (or alternatively, a different type or level ofdithering added).

In portion 610 b, a sub-portion 640 b includes a dithering noise patternwhich has been added by relatively more complex processing—e.g. ascompared to that for providing dithering in sub-portion 640 a. Suchprocessing may provide for dithering in sub-portion 640 b to betterconform to all of that area which has been identified as representingsmooth video content. As with sub-portion 630 a, a sub-portion 630 b ofportion 610 b may represent edge image content which has different, orno, dithering added.

In portion 610 c, a sub-portion 640 c and another sub-portion 650 c mayeach represent respective smooth video content, where sub-portions 640c, 650 c are on opposite sides of a sub-portion 630 d representing edgevideo content. Video data processing according to an embodiment mayprovide for respective dithering artefacts in each of sub-portions 640c, 650 c—e.g. where sub-portion 630 d has different dithering, or nodithering, added.

Portion 610 d may include one or more of sub-portions 630 d, 640 d, 650d which, respectively, include some or all of the features ofsub-portions 630 c, 640 c, 650 c. Certain embodiments provide forselectively varying projection refresh rates—e.g. in addition toselectively adding dithering artefacts as discussed herein. For example,a sub-portion representing smooth video content, such as sub-portion 640d may be projected on the display screen at a higher refresh rate thanthat for projecting the sub-portion 630 representing edge video content.Such a higher refresh rate is represented in portion 610 d by therelatively high contrast pattern in sub-portion 640 d.

FIG. 7 illustrates elements of a system 700 for displaying video imagesaccording to an embodiment. System 700 includes a video processor 710 toprocess audio-video information in preparation for image sub-portions tobe displayed—e.g. by display hardware of system 700 such as that ofdisplay 100, display 300 or the like. For example, video processor 710may include some or all of the features of video processor 500.

In an embodiment, video processor 710 includes feature recognition logic720 to receive one or more frames of audio/video information—asrepresented by the illustrative frames 705. Feature recognition logic720 may identify first video data 722 of frames 705 as representingsmooth image content. Alternatively or in addition, feature recognitionlogic 720 may identify second video data 724 of frames 705 asrepresenting edge image content, as discussed herein. In response tosuch identifying, feature recognition logic 720 may variously directfirst video data 722 and second video data 724 for different respectivevideo processing—e.g. where, of first video data 722 and second videodata 724, only first video data 722 is processed by enhancement logic730 of video processor 710.

In an embodiment, identification of first video data 722 and secondvideo data 724 may additionally or alternatively be based on information715 received from or otherwise describing another system (e.g. anotherdisplay device, not shown) which operates with system 700. For example,information 715 may include video data which the other system is todisplay. Alternatively or in addition, information 715 may indicate aposition or other configuration of the other system relative to system700. Based on information 715, feature recognition logic 720 may, incertain embodiments, identify a video data portion of frames 705 ascorresponding to a video data portion of information 715—e.g. where suchvideo data portions are to represent respective image content which areto adjoin one another. In response to such identification, featurerecognition logic 720 may use such video data portion of information 715for improved edge detection and/or related operations as discussedherein. In some embodiments, feature recognition logic 720 may provide aresult of such operations to the other system or, alternatively, to someother device for controlling image display operations of the othersystem.

Enhancement logic 730 may add a noise component to some or all of firstvideo data 722 to generate a modified version of first video data 722,as represented by enhanced video data 732. Combination logic 734 ofvideo processor 710 may combine second video data 724 and enhanced videodata 740 with one another to generate output 736 for additionalprocessing—e.g. by video data processing logic 740 which, for example,provides functionality adapted from conventional video data encodingtechniques.

In an embodiment, operation of video processor 700 controls otherdisplay hardware of system 700. For example, display hardware of system700 may include an illumination layer 760 and a display layer 762.Operation of illumination layer 760 and display layer 762 may correspondto operation of illumination layer 130 and display layer 120,respectively.

For example, illumination layer 760 may include a respectiveillumination elements (IE) for each of a plurality of regions of displaylayer 762. By way of illustration and not limitation, illumination layer760 may include multiple rows of IEs comprising, for example, a firstrow including illumination elements IE11, IE12, IE13, a second rowincluding illumination elements IE21, IE22, IE23, a third row includingillumination elements IE31, IE32, IE33 and/or the like. Over time,individual IEs of illumination layer 760 may each be activatedrepeatedly, where each such activation is for that IE to emit light toilluminate a corresponding region—e.g. a corresponding pixelet (notshown)—of display layer 762. Such light illuminates through an imagesub-portion which is concurrently displayed on that region of thedisplay layer, resulting in a magnified image sub-portion beingprojected onto a screen layer (not shown) of system 700

In an embodiment, some or all of IEs of illumination layer 762 may bevariously operated—e.g. independent of one another—to provide fordifferent refresh rates for the illumination of different respectiveregions of display layer 762. For example, system 700 may include adisplay layer controller 752 which controls how image sub-portions areto be variously displayed at different regions of display layer 762.Such control may be based, for example, on display layer controller 752receiving decoded video data information from video data processinglogic 740 or other hardware of video processor 710. Alternatively or inaddition, system 700 may include a refresh controller 750 which controlshow IEs of illumination layer 760 are to variously illuminate such imagesub-portions displayed on display layer 762.

For example, operation of refresh controller 750 and display layercontroller 752 may be coordinated based on signals 754 exchangedbetween, or otherwise shared by, refresh controller 750 and displaylayer controller 752. Refresh controller 750 may further operate basedon other signals 726 specifying or otherwise indicating portions ofvideo data which represent edge image content and/or portions of videodata which represent smooth image content. Based on signals 754, 726,refresh controller 750 may detect, for each of various regions ofdisplay layer 762, when that region is displaying (or is to display)smooth video content and/or when that region is displaying (or is todisplay) edge video content. In response, refresh controller 750 mayselectively signal different refresh rates for IEs of illumination layer760 to variously illuminate different respective regions of displaylayer 762. By way of illustration and not limitation, refresh controller750 may signal element address logic 756 of system 700 to providesignaling 758 for variously addressing respective IEs of illuminationlayer 760. The signaling 758 may specify or otherwise indicate differentrefresh rates which, for example, determine illumination rates fordifferent concurrent sub-portions of the same image displayed by system700.

FIG. 8A illustrates elements of a system 800 for displaying imagesaccording to an embodiment. System 800 may include an assembly 810 oftileable display panels—e.g. including panels which each include some orall of the features of display panel 100, display panel 300 or the like.For example, assembly 810 is shown as including an illustrativetwo-by-two array of displays 812, 814, 816, 818, various pairs of whichhave respective sides adjoining one another along an x-dimension oralong a y-dimension. However, assembly 810 may include any of a varietyof additional or alternative configurations of displays, according todifferent embodiments.

Certain features of various embodiments are discussed herein withrespect to image sub-portions which are displayed at least in part bydisplay 816 at or near a side of display 16 which adjoins a side ofdisplay 812 along the x-dimension. However, such discussion may beextended to additionally or alternatively apply to image sub-portionsvariously displayed at one or more other locations of assembly 810.Displays 812, 814, 816, 818 may be variously mounted into or on a wall,ceiling, floor or other fixed structure (not shown).

Assembly 800 may include or couple to mounting hardware and/orstructures or mechanisms for connection to such mounting hardware. Oneor more mechanisms, represented by the illustrative sensors 820, 822,may detect presence—e.g. including detecting proximity and/orposition—of one display in relation to another display. By way ofillustration and not limitation, sensors 820 may provide laser, magneticand/or other sensor mechanisms to detect adjacency of displays 812, 816to one another and/or to detect configuration of displays 812, 816 withrespect to one another. Alternatively or in addition, sensors 822 maysimilarly detect proximity and/or configuration of displays 816, 818with respect to one another.

System 830 may include a video processor 830 which, for example, isincluded in or coupled to display 816. Video processor 830 may processframes of AV information to enhance video data for display 816—e.g.according to the techniques of method 400. In an embodiment, videoprocessor 830 receives information—e.g. from some or all of sensors 820,822—which specifies or otherwise indicates a configuration of devices inassembly 810 with respect to one another. Additionally or alternatively,such information may include a version of video data which is to bedisplayed by display 812 (or another display of assembly 810). Based onsuch information, video processor 830 may identify video data fordisplay 812 as corresponding to other video data for video data fordisplay 816—e.g. where such video data portions are to representrespective adjoining image content. In response to such identification,video processor 830 may use both such video data portions—e.g. forimproved edge detection.

FIG. 8B illustrates elements of an image 850 displayed by system 800based on video data which is enhanced according to an embodiment. Image850 may be displayed based on video data which is enhanced by videoprocessor 830—e.g. according to method 400. The displayed image 850includes a region 860 and regions 862, 864, 866, 868 which each adjoin arespective side of region 860. Some or all of regions 860, 862, 864,866, 868 may be regions of the same display—e.g. regions of a screenlayer of display 816. Alternatively, regions 860, 862, 864, 866, 868 mayinclude regions of different displays—e.g. where region 860 is a regionof a screen layer of display 816 and region 862 is a region of a screenlayer of display 812. In an embodiment, regions 860, 862, 864, 866, 868each correspond to a different respective pixelet which is illuminatedfor projection of a corresponding portion of the displayed image 850.

As shown in FIG. 8B, region 860 may include sub-regions R1, R2 which areclosest to regions 862, 868, respectively, and sub-regions C1, C2 whichare closest to regions 864, 866, respectively. In an embodiment, thevideo processor 830 may selectively add video data dithering and/orselectively set a refresh rate based on whether (or not) video datacorresponds to image content in one of R1, R2, C1, C2. Such selectivedithering and/or refreshing may be variously performed concurrently formultiple regions. By way of illustration and not limitation, a portion870 of displayed image 850 includes respective sub-portions 874, 876 ofregions 860, 862. Sub-portions 874, 876 may adjoin one another along aninterface 872, which may be an interface between adjacent displays(although certain embodiments are not limited in this regard).

In an illustrative scenario according to one embodiment, an imagesub-region 880 a in sub-portion 876 may represent edge image content andan image sub-region 880 b in sub-portion 874 may represent edge imagecontent. Identification of either or each of sub-regions 880 a, 880 b asrepresenting edge image content may be based on features recognition ofrespective video data for both of sub-regions 880 a, 880 b. Certainembodiments variously perform video data enhancement to improveperceived resolution of smooth image content adjoining at least one ofsub-regions 880 a, 880 b. For example, one or both of a sub-region 882 aand/or a sub-region 884 a of region 860 may be identified asrepresenting smooth video content. In response to such identification,video data enhancement may provide for dithering in one or both ofsub-regions 882 a, 884 a—e.g. where sub-region 880 a is selectivelyexcluded from the providing of such dithering. Alternatively or inaddition, one or both of a sub-region 882 b and/or a sub-region 884 b ofregion 862 may be identified as representing smooth video content. Inresponse to such identification, video data enhancement may provide fordithering in one or both of sub-regions 882 b, 884 b—e.g. wheresub-region 880 b is selectively excluded from the providing of suchdithering. The combination of selective dithering for each ofsub-regions 874, 876—e.g. in addition to selectively determiningdifferent refresh rates for respective portions of image 850—may improvethe perceived resolution of image content along interface 872.

FIG. 9 is an illustration of components of a device to utilize anembodiment of the disclosure. Platform 900 may be used for one of thetileable display panels described above. Platform 900 may also be usedto provide video processing, power, display control computing ability(e.g., decoding and converting content) and/or connectivity (e.g.,network connectivity) to a device including a tileable display panel.For example, platform 900 may comprise display driver componentscommunicatively coupled to the above described tileable display panel.Platform 900 may be used to decode/convert content into video signalformats such as high definition multimedia interface (HDMI), component,composite digital visual interface (DVI), video graphics adapter (VGA),Syndicat des Constructeurs d'Appareils Radiorecepteurs et Televiseursor(SCART), or other video signal formats.

Platform 900 as illustrated includes bus or other internal communicationmeans 915 for communicating information, and processor 910 coupled tobus 915 for processing information. The platform further comprisesrandom access memory (RAM) or other volatile storage device 950(alternatively referred to herein as main memory), coupled to bus 915for storing information and instructions to be executed by processor910. Main memory 950 also may be used for storing temporary variables orother intermediate information during execution of instructions byprocessor 910. Platform 900 also comprises read only memory (ROM) and/orstatic storage device 920 coupled to bus 915 for storing staticinformation and instructions for processor 910, and data storage device925 such as a magnetic disk, optical disk and its corresponding diskdrive, or a portable storage device (e.g., a universal serial bus (USB)flash drive, a Secure Digital (SD) card). Data storage device 925 iscoupled to bus 915 for storing information and instructions.

Platform 900 may further be coupled to display device 970, such as acathode ray tube (CRT) or an LCD coupled to bus 915 through bus 965 fordisplaying information to a computer user. In embodiments where platform900 provides computing ability and connectivity to a created andinstalled display device, display device 970 may comprise any of thetileable display panels described above. Alphanumeric input device 975,including alphanumeric and other keys, may also be coupled to bus 915through bus 965 (e.g., via infrared (IR) or radio frequency (RF)signals) for communicating information and command selections toprocessor 910. An additional user input device is cursor control device980, such as a mouse, a trackball, stylus, or cursor direction keyscoupled to bus 915 through bus 965 for communicating directioninformation and command selections to processor 910, and for controllingcursor movement on display device 970. In embodiments utilizing atouch-screen interface, it is understood that display 970, input device975 and cursor control device 980 may all be integrated into atouch-screen unit.

Another device, which may optionally be coupled to platform 900, is acommunication device 990 for accessing other nodes of a distributedsystem via a network. Communication device 990 may include any of anumber of commercially available networking peripheral devices such asthose used for coupling to an Ethernet, token ring, Internet, or widearea network. Communication device 990 may further be a null-modemconnection, or any other mechanism that provides connectivity betweencomputer system 900 and the outside world. Note that any or all of thecomponents of this system illustrated in FIG. 9 and associated hardwaremay be used in various embodiments of the disclosure.

It will be appreciated by those of ordinary skill in the art that anyconfiguration of the system illustrated in FIG. 9 may be used forvarious purposes according to the particular implementation. The controllogic or software implementing embodiments of the disclosure can bestored in main memory 950, mass storage device 925, or other storagemedium locally or remotely accessible to processor 910.

It will be apparent to those of ordinary skill in the art that anysystem, method, and process to capture media data as described hereincan be implemented as software stored in main memory 950 or read onlymemory 920 and executed by processor 910. This control logic or softwaremay also be resident on an article of manufacture comprising a computerreadable medium having computer readable program code embodied thereinand being readable the mass storage device 925 and for causing processor910 to operate in accordance with the methods and teachings herein.

Embodiments of the disclosure may also be embodied in a handheld orportable device containing a subset of the computer hardware componentsdescribed above. For example, the handheld device may be configured tocontain only the bus 915, the processor 910, and memory 950 and/or 925.The handheld device may also be configured to include a set of buttonsor input signaling components with which a user may select from a set ofavailable options. The handheld device may also be configured to includean output apparatus such as a LCD or display element matrix fordisplaying information to a user of the handheld device. Conventionalmethods may be used to implement such a handheld device. Theimplementation of the disclosure for such a device would be apparent toone of ordinary skill in the art given the disclosure as providedherein.

Embodiments of the disclosure may also be embodied in a special purposeappliance including a subset of the computer hardware componentsdescribed above. For example, the appliance may include processor 910,data storage device 925, bus 915, and memory 950, and only rudimentarycommunications mechanisms, such as a small touch-screen that permits theuser to communicate in a basic manner with the device. In general, themore special-purpose the device is, the fewer of the elements need bepresent for the device to function.

Techniques and architectures for enhancing image displays are describedherein. In the above description, for purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of certain embodiments. It will be apparent, however, toone skilled in the art that certain embodiments can be practiced withoutthese specific details. In other instances, structures and devices areshown in block diagram form in order to avoid obscuring the description.

Reference in the specification to “one embodiment” or “an embodiment”means that a particular feature, structure, or characteristic describedin connection with the embodiment is included in at least one embodimentof the invention. The appearances of the phrase “in one embodiment” invarious places in the specification are not necessarily all referring tothe same embodiment.

Some portions of the detailed description herein are presented in termsof algorithms and symbolic representations of operations on data bitswithin a computer memory. These algorithmic descriptions andrepresentations are the means used by those skilled in the computingarts to most effectively convey the substance of their work to othersskilled in the art. An algorithm is here, and generally, conceived to bea self-consistent sequence of steps leading to a desired result. Thesteps are those requiring physical manipulations of physical quantities.Usually, though not necessarily, these quantities take the form ofelectrical or magnetic signals capable of being stored, transferred,combined, compared, and otherwise manipulated. It has proven convenientat times, principally for reasons of common usage, to refer to thesesignals as bits, values, elements, symbols, characters, terms, numbers,or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the discussion herein, itis appreciated that throughout the description, discussions utilizingterms such as “processing” or “computing” or “calculating” or“determining” or “displaying” or the like, refer to the action andprocesses of a computer system, or similar electronic computing device,that manipulates and transforms data represented as physical(electronic) quantities within the computer system's registers andmemories into other data similarly represented as physical quantitieswithin the computer system memories or registers or other suchinformation storage, transmission or display devices.

Certain embodiments also relate to apparatus for performing theoperations herein. This apparatus may be specially constructed for therequired purposes, or it may comprise a general purpose computerselectively activated or reconfigured by a computer program stored inthe computer. Such a computer program may be stored in a tangible ornon-transitory machine (e.g., computer) readable storage medium, thatwhen executed by a machine will cause the machine to perform theoperations described. A tangible machine-readable storage mediumincludes any mechanism that provides (i.e., stores) information in anon-transitory form accessible by a machine (e.g., a computer, networkdevice, personal digital assistant, manufacturing tool, any device witha set of one or more processors, etc.). For example, such a storagemedium may include, but is not limited to, any of various storage disksincluding floppy disks, optical disks, CD-ROMs, and magnetic-opticaldisks, read-only memories (ROMs), random access memories (RAMs) such asdynamic RAM (DRAM), EPROMs, EEPROMs, magnetic or optical cards, or anytype of media suitable for storing electronic instructions, and coupledto a computer system bus. Additionally, the processes may be embodiedwithin hardware, such as an application specific integrated circuit(“ASIC”) or otherwise.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general purposesystems may be used with programs in accordance with the teachingsherein, or it may prove convenient to construct more specializedapparatus to perform the required method steps. The required structurefor a variety of these systems will appear from the description herein.In addition, certain embodiments are not described with reference to anyparticular programming language. It will be appreciated that a varietyof programming languages may be used to implement the teachings of suchembodiments as described herein.

Besides what is described herein, various modifications may be made tothe disclosed embodiments and implementations thereof without departingfrom their scope. Therefore, the illustrations and examples hereinshould be construed in an illustrative, and not a restrictive sense. Thescope of the invention should be measured solely by reference to theclaims that follow.

What is claimed is:
 1. A non-transitory computer-readable storage mediumhaving stored thereon instructions which, when executed by one or moreprocessing units, cause the one or more processing units to perform amethod comprising: receiving one or more frames of audio/videoinformation including first video data and second video data;identifying the first video data as representing smooth image content,wherein the second video data represents edge image content; selectivelyperforming first image processing based on the first video data beingidentified as representing smooth image content, including applying afirst noise component to generate a first modified version of the firstvideo data, wherein, of the first video data and the second video data,the first image processing modifies only the first video data, andwherein a first tileable display device generates a first image based onthe first image processing; receiving other video data and a descriptionof a configuration of a second tileable display device relative to thefirst tileable display device, wherein the second tileable displaydevice generates a second image based on the other video data, andwherein the first video data is identified as representing smooth imagecontent based on the other video data and further based on thedescription of the configuration of the second tileable display devicerelative to the first tileable display device.
 2. The computer-readablestorage medium of claim 1, wherein the first noise component provides adithering effect for the smooth image content.
 3. The computer-readablestorage medium of claim 1, wherein selectively performing the firstimage processing further comprises applying a second noise component togenerate a second modified version of the first video data, the methodfurther comprising: outputting the first modified version of the firstvideo data for a display of a first magnified image sub-portion at afirst display location; and outputting the second modified version ofthe first video data for a display of a second magnified imagesub-portion at the first display location.
 4. The computer-readablestorage medium of claim 1, further comprising selectively setting arefresh rate based on the first video data being identified asrepresenting smooth image content.
 5. The computer-readable storagemedium of claim 4, wherein, of the first video data and the second videodata, the refresh rate is set for only the first video data.
 6. Thecomputer-readable storage medium of claim 4, wherein the refresh rate isset for the first video data, and wherein the refresh rate is greaterthan another refresh rate for the second video data.
 7. Thecomputer-readable storage medium of claim 1, further comprisingconcurrently performing: first refreshes at a first rate for magnifiedimage sub-portions at a first location of the first tileable displaydevice; and second refreshes at a second rate for magnified imagesub-portions at a second location of the first tileable display device.8. A method implemented by a video processor, the method comprising:receiving one or more frames of audio/video information including firstvideo data and second video data; identifying the first video data asrepresenting smooth image content, wherein the second video datarepresents edge image content; selectively performing first imageprocessing based on the first video data being identified asrepresenting smooth image content, including applying a first noisecomponent to generate a first modified version of the first video data,wherein, of the first video data and the second video data, the firstimage processing modifies only the first video data, and wherein a firsttileable display device generates a first image based on the first imageprocessing; receiving other video data and a description of aconfiguration of a second tileable display device relative to the firsttileable display device, wherein the second tileable display devicegenerates a second image based on the other video data, and wherein thefirst video data is identified as representing smooth image contentbased on the other video data and further based on the description ofthe configuration of the second tileable display device relative to thefirst tileable display device.
 9. The method of claim 8, wherein thefirst noise component provides a dithering effect for the smooth imagecontent.
 10. The method of claim 8, wherein selectively performing thefirst image processing further comprises applying a second noisecomponent to generate a second modified version of the first video data,the method further comprising: outputting the first modified version ofthe first video data for a display of a first magnified imagesub-portion at a first display location; and outputting the secondmodified version of the first video data for a display of a secondmagnified image sub-portion at the first display location.
 11. Themethod of claim 8, further comprising selectively setting a refresh ratebased on the first video data being identified as representing smoothimage content.
 12. The method of claim 11, wherein, of the first videodata and the second video data, the refresh rate is set for only thefirst video data.
 13. A video processor device comprising: featurerecognition logic configured to receive one or more frames ofaudio/video information including first video data and second videodata, the feature recognition logic including circuitry configured toidentify the first video data as representing smooth image content,wherein the second video data represents edge image content; andenhancement logic configured to selectively perform first imageprocessing based on the first video data being identified asrepresenting smooth image content, the first image processing to apply afirst noise component to generate a first modified version of the firstvideo data, wherein, of the first video data and the second video data,the first image processing modifies only the first video data, wherein afirst tileable display device is to generate a first image based on thefirst image processing; wherein the feature recognition logic further toreceive other video data and a description of a configuration of asecond tileable display device relative to the first tileable displaydevice, wherein the second tileable display device is to generate asecond image based on the other video data, and wherein the featurerecognition logic to identify the first video data as representingsmooth image content based on the other video data and further based onthe description of the configuration of the second tileable displaydevice relative to the first tileable display device.
 14. The videoprocessor device of claim 13, wherein the first noise component providesa dithering effect for the smooth image content.